Multimedia
The Tegra Linux Driver Package includes the multimedia framework modules for testing purposes.
For GStreamer information consult:
• Jetson TX1 Accelerated GStreamer User Guide
• Jetson TX2 Accelerated GStreamer User Guide
Multimedia API
The Multimedia API is a collection of low-level APIs that support flexible application development. These low-level APIs enable flexibility by providing better control over the underlying hardware blocks.
The Multimedia API includes:
• libargus for imaging applications
• V4L2 API for encoding, decoding, scaling, and other media functions
• NVOSD for On-Screen display
• Buffer Utility for buffer allocation, management, and sharing
Examples are provided to demonstrate:
• Image processing with CUDA
• Object detection and classification with cuDNN
• TensorRT and OpenCV4Tegra usage
The Multimedia API provides another application development path for those not using a framework such as GStreamer, or for developers leveraging custom frameworks.
The Multimedia API reference is available for download at:
https://developer.nvidia.com/embedded/downloads
GStreamer-based Multimedia Playback
Use the GStreamer open source multimedia framework and the NvGstPlayer utility for testing multimedia local playback and HTTP/RTSP streaming playback use cases. The NvGstPlayer can be used as a reference implementation.
For more information about the NvGstPlayer application, refer to the ReadMe file included with the release.
Installing GStreamer
Install GStreamer from the Internet directly on the target. The wrapper library, gst-openmax, is an interface between GStreamer and OpenMAX. It enables accelerated NVIDIA plug-ins in the GStreamer framework.
For more information about GStreamer, see the following website:
NvGstPlayer is a multimedia player test application.
Complete prerequisite steps in the file nvgstcapture_README.txt before running the NvGstPlayer and NvGstCapture applications.
Instructions for installing GStreamer are also included in that text file.
Using NvGstPlayer
NvGstPlayer is a command line media file player. It plays audio/video files encapsulated in MP4, 3GP, AVI, ASF, WMA, MKV, M2TS, WEBM, and MOV. NvGstPlayer supports local file playback and playback over RSTP, HTTP, and UDP.
For information about NvGstPlayer runtime commands, default settings, and important notes see the nvgstplayer_README.txt file included in the release.
GStreamer-based Camera Capture (NvGstCapture)
NvGstCapture is a command line Camera capture appliation. NvGstCapture captures video data using a camera and encapsulate encoded Video data in the container file.
For information about NvGstCapture runtime commands, default settings, and important notes see the nvgstcapture-1.0_README.txt file included in the release.
